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Abstract 

Connected operators are filtering tools that act by 
merging elementary regions of an image. A popular 
strategy is based on tree-based image representations: 
for example, one can compute an attribute on each node 
of the tree and keep only the nodes for which the at- 
tribute is sufficiently strong. This operation can be seen 
as a thresholding of the tree, seen as a graph whose 
nodes are weighted by the attribute. Rather than being 
satisfied with a mere thresholding, we propose to ex- 
pand on this idea, and to apply connected filters on this 
latest graph. Consequently, the filtering is done not in 
the space of the image, but on the space of shapes build 
from the image. 

Such a processing is a generalization of the existing 
tree-based connected operators. Indeed, the framework 
includes classical existing connected operators by at- 
tributes. It also allows us to propose a class of novel 
connected operators from the leveling family, based on 
shape attributes. Finally, we also propose a novel class 
of self-dual connected operators that we call morpho- 
logical shapings. 



1. Introduction 

Mathematical morphology, as originally developed 
by Matheron and Serra 1 10 |, proposes a set of morpho- 
logical operators based on structuring elements. Later, 
Salembier and Serra O, followed by Breen and Jones 
|1|, proposed morphological operators based on at- 
tributes, rather than on elements. Such operators rely 
on transforming the image into an equivalent represen- 
tation, generally a tree of components {e.g. level sets) 
of the image; such trees are equivalent to the original 
image in the sense that the image can be reconstructed 




Figure 1. Classical connected operators 
(black path) and our proposed process 
(by adding the red path). 



from its associated tree. Filtering then involves the de- 
sign of a shape attribute that weights how much a node 
of the tree fits a given shape. Two different approaches 
for filtering the tree (and hence the image) have been 
proposed: the more evolved approach consists in prun- 
ing the tree by removing whole branches of the tree, and 
is easy to apply if the attribute is increasing on the tree 
{i.e., if the attribute is always stronger for the ancestors 
of a node). The process is illustrated in Figure [T]by the 
black path. 

However, most shape attributes are not increasing. 
When the attribute is not increasing, three strategies 
have been proposed (min, max, Viterbi; see | 9 1 for more 
details). They all choose a particular node on which to 
take the decision, and remove the whole subtree rooted 
in this node. While it may give interesting results in 
some cases, it does not take into account the possibil- 
ity that several relevant objects can have some inclu- 
sion relationship, which means that they are on the same 
branch of the tree (for instance a ring object in a tree of 
shapes, see Figure |5] (a)). 

In the simplest approach, one simply removes the 
nodes of the tree for which the attribute is lower than 
a given threshold ifTTIl . Such a thresholding does not 



take into account the intrinsic parenthood relationship 
of the tree. Moreover it is often impossible to retrieve 
all expected objects with one unique threshold. 

The founding idea of this paper is to apply connected 
filters on the space made by all the components of the 
image, such space being structured into a graph by the 
parenthood relationship (i.e., a node has for neighbors 
its children and its parent). This is the red path in Fig- 
ure [T] This surprising and simple idea has several deep 
consequences, that form the main contributions of this 
paper. First, we show that the framework encompasses 
the usual attribute filtering operators. Second, novel 
connected filters based on non-increasing criterion can 
be proposed, and we show that such filters are new mor- 
phological levelings |4|. And third, we propose a novel 
family of self-dual connected filters that we call mor- 
phological shapings. 

The rest of this paper is organized as follows. Our 
proposed shape-based morphology is explained in Sec- 
tion [2] In Section [3] we depict some experimental re- 
sults. Finally we conclude in Section |4] 

2. Shape-based morphology 

As stated in the introduction, one way to compute 
connected operators is to represent the input image / 
by a component tree T, either a min-tree (given by the 
inclusion relationship of the connected components of 
the lower level sets), a max-tree |7 1 (upper level sets), 
or a tree of shapes |5|. The connected components are 
given thanks to a neighborhood, usually C4 or C8. Let 
us remark that the tree T with its nodes valued with an 
attribute A can be seen as a node-weighted graph where 
vertices are tree nodes, adjacency (graph edges) is par- 
enthood. Such a graph is a shape-space, as any node 
is a component of the original image. As an edge of 
the graph represents an inclusion relationship between 
components, the neighborhood of a node is a kind of 
"context" of the node (component) in the image. 

If, for example, A encodes the probability for a com- 
ponent to be of a given type, the minima of the space of 
shapes are the components that are the less probable to 
be of that type, compared to their parents and children. 
As a node-weighted graph, the space T can be repre- 
sented by a component tree TT (explicitly and for clar- 
ity a min-tree in the sequel of this paper). Minima of 
A onT are leaves of TT. Pruning or removing some 
branches of the new tree TT thus removes the parts of 
T that are less likely to be of the type favored by A. 
Remark that with this strategy, we can remove two dif- 
ferent "objects" located in the same branch of T, but 
represented by two different branches of TT. 

Let us now compare our approach with the state of 
the art in connected filtering. The regular case is when 
the attribute A is increasing, i.e. when A is lower for a 
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Figure 2. Illustration of the extinction val- 
ues of three minima. 

component than for its parent. In that case, the min-tree 
TT is equal to T. Taking the red path in Figure [T] is 
equivalent to taking the black path. In other words, the 
proposed approach encompasses the classical one. 

A shape-attribute A is more often non-increasing. In 
such a case, TT is different from T. Figure [2] shows 
an example of a non-increasing attribute in a branch of 
T. Pruning TT is equivalent to the thresholding of A 
on T. In Figure [2j such a pruning removes the nodes 
whose A is under the purple line. 

Another classical strategy is to compute an attribute 
AA on TT, and to prune the tree according to this at- 
tribute in shape-space. In that case, 

• when the tree T is a min-tree or a max-tree, such 
a morphological filtering in shape space is a lev- 
eling of the original image (recall that an operator 
is a leveling if and only if it preserves the order < 
and > between neighboring pixels). We call such 
a filtering shape-based leveling. 

• when the tree T is a tree of shape, then the order 
between neighboring pixels is no longer preserved 
by the filtering, and it is thus no longer a leveling. 
We call this new family of self-dual morphological 
connected filters the morphological shapings. 

Of course, AA can be as simple as the height of a 
component in the shape space. But other attributes AA 
can be computed based on A or even the image domain: 
for example, the area of a connected component of TT 
can be the number of pixels of this set of components in 
the original image. 

Let us mention another interesting variant for the 
filtering strategy. It is based on the use of extinction 
value 1 12 1 of minima. Let ^ be a strict total order on the 
set of minima mi ^ m2 ^ . . such that ^ m^+i 
whenever the altitude of is lower than the altitude 
of m^+i. Let CC be the lowest connected compo- 
nent that contains both m^+i and a minimum rnj with 
j < (^+1). The extinction value for the minimum m^+i 
is defined as the difference between the altitude of CC 
and the altitude of m^+i. Figure |2] shows an example 
of the extinction value for three minima. The order is 
A < C < B. The filtering strategy is to preserve (or re- 
move) only the blobs determined by a minimum whose 
extinction value is higher than a given value. The ad- 
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(a) Input image. 


(b) Shape-based leveling 
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(c) is (a) minus (b). (d) Object detection. 

Figure 3. Illustration of shape-based lev- 
eling and object detection. 
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Figure 4. (a) Evolution of "circularity" on 
two branches of T; (b to e): Some shapes; 
(f) Attribute thresholding; (g) Shaping. 



vantage of this strategy is that it preserves only those 
shapes which are meaningful enough compared to their 
context. For example, the red part in Figure [2] is pre- 
served for the value given by the purple line, but the 
blobs corresponding to minima B and C are removed. 

3. Some illustrations 

In this section, we present some illustrations of our 



new filters, both for image filtering (section 3.1 ) and for 



object detection (section 3.2). 



3.1. Object filtering 

In Figure |3j we present a round shape-based leveling 
filter. For that, T is the min-tree of the input image (a) 
and ^ is a circularity attribute. The tree simplification 
TT TT' is performed by a morphological closing 
of A A. The reconstruction gives the filtered image (b), 
which is a leveling of the input image. The image (c) 
is a top-hat (subtraction of the leveling from the input 
image) that depicts the objects removed by the filter. 

Figure |4] shows an example of evolution of a shape 
attribute, the circularity on a simple image. The light 
round shape and the dark one are both meaningful round 
objects compared to their context. However, their at- 
tribute values are very different. In order to obtain the 
light one, a higher threshold is applied, but this makes 
some non desired shapes appear, the shapes presented 
in the background in Figure [4] (f). 

In Figure [5j we compare our extinction-based self- 
dual shaping approach with a variant of the state-of- 




(a) Input image. 



(b) Shaping 1. 



(c) Low threshold of A. (d) Higher threshold of A. 
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(f) Shaping 2. 



(e) Threshold strategy. 

Figure 5. Comparison of extinction-based 
shapings with attribute-thresholding, (b- 
d): Using one shape attribute; (e-f): Using 
a combination of shape attributes. 



the-art thresholding approach ifTTIl . To process both up- 
per and lower level sets, we propose to use a tree of 
shapes T. In this illustration A is the circularity of im- 
age shapes for (b) to (d). When the threshold of A is 
low, we loose some objects (see (c)). To be able to get 
all expected objects, we have to set a high threshold; 
however, we keep too many unwanted objects (see (d)). 
With our shaping filter, we obtain all the expected ob- 
jects as depicted in (b). The results can be improved 
by combining some shape attributes. In (e) and (f), we 
use a combination of circularity and the I/A'^ |11|, the 
moment of inertia divided by the square of area. The 
combination of shape attributes improves significantly 
the results. Still, our shaping in (f) performs much bet- 
ter than the threshold strategy in (e). 

3.2. Object detection 

Some authors have proposed to rely on image repre- 
sentation based on morphological trees to extract mean- 
ingful objects. In |6|, objects are selected when their 
level lines match some criterion based on compactness 
and contrast. In | 2 1, objects are spotted as minima of the 
number of false alarms estimated on every level lines 
thanks to an a contrario model. We have introduced 
in |[T3l an energy functional, computed on image com- 
ponents of the tree of shapes and dedicated to object 
detection. This functional mixes a snake-like term and 
a contextual Mumford-Shah term, and its minima corre- 
spond to potential meaningful objects. Put differently T 
is the tree of shapes and A is the energy functional. To 
extract the significant minima (so the proper objects), 
we compute the min-tree TT of the space of shapes T 
valued with attribute A\ a morphological closing with 
attribute AA provides a simplified tree TT'\ the only 
minima remaining in TT' are the relevant objects. 

This strategy is valid for any general-purpose energy 
functional, including any shape attribute, or a combina- 
tion of shape attributes. As such, we are able to extract 
objects based on their shape features. In Figure [3] (d), 
red and green contours correspond to components with 
significant minima of respectively a circularity attribute 
and an elongation attribute. 

4. Conclusion 

This paper has presented two new classes of mor- 
phological connected filters: new levelings (obtained 
with T being the min-tree or the max-tree) and self-dual 
shapings (obtained with T being the tree of shapes 151). 
Those connected operators filter image components 
based on some non-increasing shape criterion. We have 
also shown that they encompass the usual attribute fil- 
tering operators. Properties of the morphological shap- 
ing (such as conditions for idempotence) will be studied 



in a forthcoming extended version. 

We have implemented those filters using our C++ 
image processing library |3|, available on the Internet 
as free software. The present paper also demonstrates 
the interest of applying image processing algorithms to 
different types of graphs, in other words, the interest of 
genericity for image processing. 
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